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Abstract : We propose a new sequential procedure to detect change in the parameters of a process X — (X t )tez 
belonging to a large class of causal models (such as AR(oo), ARCH(oo), TARCH(oo), ARMA-GARCH processes). 
The procedure is based on a difference between the historical parameter estimator and the updated parameter 
estimator, where both these estimators are based on the quasi-likelihood of the model. Unlike classical recursive 
fluctuation test, the updated estimator is computed without the historical observations. The asymptotic behavior 
of the test is studied and the consistency in power as well as an upper bound of the detection delay are obtained. 
Some simulation results are reported with comparisons to some other existing procedures exhibiting the accuracy of 
our new procedure. The procedure is also applied to the daily closing values of the Nikkei 225, S&P 500 and FTSE 
t^J- . 100 stock index. We show in this real-data applications how the procedure can be used to solve off-line multiple 
breaks detection. 
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1 Introduction 

In statistical inference, many authors have pointed out the danger of omitting the existence of changes in the data. 
Many papers have been devoted to the problem of test for parameter changes in time series models when all data 
are available, see for instance Horvath [15| . Inclan and Tiao [17, Kokoszka and Leipus [20] ■ Kim et al. |19j . Aue 
et al. [1], Bardet et al. [5], Kengne [IB]. These papers consider "retrospective" (off-line) changes i.e. changes in 
parameters when all data are available. Another point of view is the change detection when new data arrive; this is 
sequential change-point problem. An important turning on this topic was made in 1996 with the paper of Chu et al.. 
They considered the sequential change in regression model and pointed out the effects of repeating retrospective test 
every time when new data are observed; this can increase the probability of type 1 error of the test. They successfully 
applied a fluctuation test to solve the sequential change-point problem. Two procedures are developed based on 
cumulative sum (CUSUM) of residuals and recursive parameter fluctuations. Their idea has been generalized and 
several procedures are now based on this approach. Leisch et al. 23 introduced the generalized fluctuation test 
based on the recursive moving estimator which contains the test of Chu et al. [12] as a special case. Horvath et 
al. [16] introduced residual CUSUM monitoring procedure where the recursive parameter is based on the historical 
data. This procedure has been generalized by Aue et al. [2] to the class of linear model with dependent errors. 
Berkcs et al. 6 considered sequential changes in the parameters of GARCH process. According to the fact that the 
functional limit theorem assumed by Chu et al. [12] is not satisfied by the squares of residuals of GARCH process, 
they developed a procedure based on quasi-likelihood scores. Na et al. |25] developed a monitoring procedure for 



the detection of parameter changes in general time series models. They show that under the null hypothesis of no 
change, their detector statistic converges weakly to a known distribution. However, the asymptotic behavior of this 
detector is unknown under the alternative of parameter changes. 



In this new contribution, we consider a large class of causal time series and investigate the asymptotic behavior 
under the null hypothesis of no change but also under the alternative hypothesis of change. More precisely, let 
M, f : 2R W — > M be measurable functions, (£t)tez be a sequence of centered independent and identically distributed 
(iid) random variables satisfying var(£ ) = a 2 and let 6 be a fixed compact subset of M d . Let T C Z, and for any 
6 e 6, define 

Class A4t(M0, fg): The process X — (Xt)teZ belongs to M.t(M$, fo) if it satisfies the relation: 



The existence and properties of this general class of causal and affine processes were studied in Bardet and Winten- 
berger g]. Numerous classical time series (such as AR(oo), ARCH(oo), TARCH(oo), ARMA-GARCH or bilinear 
processes) are included in A4z(M, /). The off-line change detection for such a class of models has already been 
studied in Bardet et al. [5] and Kengne [18] . 

Suppose now that we have observed X\ , ■ ■ ■ , X n which are available historical data. We assume that the histor- 
ical data depends on one parameter i.e. there exists 6$ € Q such as (X^, ■ ■ ■ ,X n ) belongs to M.{i t ... >n y(Mg*, f$*). 
Then, we observe new data X n +i, X n +2 ■ ■ ■ ,Xk, •■■ ■ the monitoring starts. For each new observation, we would 
like to know if a change occurs in the parameter 9q . More precisely, we consider the following test : 

Ho: #o 1S constant over the observation X±, ■ ■ ■ , X n , X n+ \, ■ ■ ■ i.e. the observations X\, • • • , X n , X n+ i, ■ ■ ■ belong 
to Mn(Mg 5 ,fg 5 y, 

Hi : there exist k* > n, 0* € 8 such that Xi, ■ ■ ■ , X n , X n+ i, • • • , X^- , X k *+i, ■ ■ ■ belongs to 
M {1 ,.., k , } (M es ,f e .)r\M {k * +1 ,... } (Me 1 ,fg 1 ). 

When new data arrive, Chu et al. 12J proposed to compute an estimator of the parameter based on all the 
observations and to compare it to an estimator based on historical data. A large distance between both these esti- 
mators means that new data come from a model with different parameters. Then the null hypothesis Hq is rejected 
and the monitoring stops; otherwise, the monitoring continues. In their procedure, Leisch et al. [23] suggested to 
compute the recursive estimators on a moving window with a fixed width. They fixed a monitoring horizon so that, 
the procedure will stop after a fixed number of steps even if no change is detected. As Chu et al. [12], the recursive 
estimators computed by Na et al. are based on all the observations. As we will see in the next sections, their 
procedure cannot be effective in terms of detection delay or if a small change in the parameter occurs. 

For any k > 1, £,£' E {1, • • • , k} (with t < £') let 0(Xg, ■ ■ ■ ,Xgi) be the quasi-maximum likelihood estimator 
(QMLE in the sequel) of the parameter computed on {£, ■ ■ ■ , £'} (see its definition in ([6])). When new data arrive at 
time k > n, we explore the segment {£, £ + 1, • • • , k} with £ G {n — v n , n — v n + 1 • • • k — v n } (where (v n ) n e in is a fixed 
sequence of integer numbers) that the distance between 0(Xi, ■ ■ ■ , X k ) and 0{X\, ■ ■ ■ , X n ) is the largest. If the norm 
• ■ ■ ,Xk) — 9(X±, ■ ■ ■ ,X n )\\ is greater than a suitable critical value, then Hq is rejected and the monitoring 
stops; otherwise, the monitoring continues. More precisely, we construct a detector that takes into account the 
distance between 9(Xt, ■ ■ ■ , X k ) and 6{X\, • • • , X n ). It is shown that this detector is almost surely finite under the 
null hypothesis and almost surely diverges to infinity under the alternative. Hence, the consistency of our procedure 
follows. Simulations results compared to the procedure of Horvath et al. [16] (see also Aue et al. [2]) and Na et al. 

PTCl +u„j- „ „„„J , „,,+„„„f„„™„ :„ + — ™„ „„J j„+„„j-:„„ j„i„,. 




for all t e T. 



(1) 



In the forthcoming Section 2 the assumptions and the definition of the quasi-likelihood estimator are provided. 
In Section 3 we present the monitoring procedure and the asymptotic results. Section 4 is devoted to a simulation 
study for AR(1) and GARCH(1,1) processes. In Section 5 we apply our procedure to Nikkei 225, S&P 500 and 
FTSE 100 stock index. After conclusions in Section 6, the proofs of the main results are provided in Section 7. 

2 Assumptions and definition of the quasi-likelihood estimator 

2.1 Assumptions on the class of models Aiz(fe, Mg) 

Let 9 € M d and Mg and fg be numerical functions such that for all (xi)ieiv £ JR W , Me((xi)i e w) 7^ and 
/e((xj)ieiv) S JR- Denote hg := Mg. We will use the following classical notations: 

1. j| • || applied to a vector denotes the Euclidean norm of the vector; 

2. for any compact set K C lR d and for any g : fC — > M d , \\g\\ic — supg efc (\\g(8)\\); 

o 

3. for any set K, C M d , K denotes the interior of /C. 

Throughout the sequel, we will assume that the functions 9 1— > Mg and 9 <-> fg are twice continuously differentiable 
on 6. Let VPg = fg, Mg and i = 0, 1, 2, then for any compact set Kc8 define 

Assumption Aj(^e,/C): Assume that \\d l '$F$(p)/d& l \\8 < 00 and £/iere exists a sequence of non-negative real num- 

&ers (a^. (^g, /C)),->i sucft i/iai X] a 4 0^9) I) < 00 an< ^ 

3=1 



3=1 



In the sequel we refer to the particular case called "ARCH- type process" if /e = and if the following assumption 
holds with hg = Mg 2 : 

Assumption A.i(h$,)C): Assume that \\d l hg(Q) / 89 1 \\q < 00 and there exists a sequence of non-negative real numbers 

(01? (hg, /C))j>i such as a j(hg,lC) < 00 and 
3=1 



d'hg(x) d l hg(y) 



d6 i d9 l 



< 4 (he , K)\x) - y) \ for all x,y e M 1 

3=1 



The Lipschitz-type hypothesis Ai(^S/g,K.) are classical when studying the existence of solutions of the general model 
(see for instance [T3] )• Using a result of [3], for each model Aiz(Mg, fg) it is interesting to define the following set: 



0(r) := {9 e 9, A a (f 9 ,{9}) andj4o(M o ,{0})hold with ^af \f g ,{0}) + (E\^\ r ) 1/r J2 a f ] ( M ^{ 9 }) < X } 

3>1 3>1 

|J {9 € 6, fg = and A (V {0}) holds with (E \^\ r ) 2/r ^ "f^- W) < 1 }- 

3>1 

Then, if 6> g 0(r) the existence of a unique causal, stationary and ergodic solution X = (X t )tez € Mz(fe, Mg) 
is ensured (see more details in [4]). The subset 0(r) is defined as a reunion to consider accurately general causal 
models and ARCH-type models simultaneously. 



Here there are assumptions required for studying QMLE asymptotic properties: 



Assumption Id(9): For all (9,9') G 9 2 , 

(fg(X ,X_ 1 ,---) = fg,(X ,X_ 1 ,---) and ft e (X , -) = M*o, *-!,•••) a.s.) =► = 0'. 

<9ft# 

Assumption Var (6): For all 6 G 0, one of the families (-^r(X , ••• )) 1<i<d or (^r(I J-i, • • • )) 1<i<d 
is a.s. linearly independent. 

Assumption K(fg, Mg, 6): for i= 0, 1, 2, Aj(/g, 0) and Aj(Mg, 0) (or A^(hg, 9)) hold and there exists ^ > 2 such 
that af (fg, 9) + af{M e , 9) + af(hg, 9) = OCT') for j G JV. 

Note that in this last assumption, as in 14 , we use the convention that if Ai(Mg, 0) holds then af* (hg, 9) — and 
if Ai(/i e , 6) holds then a^(M e , 9) = 0. 

2.2 Two first examples 

1. ARMA(p, q) processes. 

Consider the ARMA(p, q) process defined by: 

p i 

x t +j2 < x t-i = E b *A-j > teZ ( 2 ) 

i=l j=0 

with b* Q £ 0, 91 = (aj, ■ ■ ■ , a*, b%, ■ ■ ■ , b*) G 6 c M p+q+1 and (&) a white noise such as £ = 1. When 
Ej=o & j 13 7^ and 1 + ]Tf =0 a*Jf l ^ for all \X\ < 1, this process can be also written as: 

OO 

*t = &o6 + X>j(0o)-X't-< . *gz 

where G O i— ► </>j($) are functions only depending on 9 and decreasing exponentially fast to (j — > oo). The 
process ([2]) belongs to the class Mz(Mg*, fg*) where fg(xi, •••) = J2j>i c f ) j{^) x 3 and ^0 = 6q for all e 6. 
Then Assumptions D(6), A (fg,@), A (M e ,9) hold with ft = \b%\ > and af\fg,0) = \\<j>j(6)\\ e while 
(Mg,0) — for j G iV*. Assumption K(/g,Me,G) holds since there exists c > and C > such as 
\4>j\ < C e~ c j for j € IV. Moreover, if (£ t ) is a sequence of non-degenerate random variables (i.e. £ t are not 
equal to a constant), Assumptions ld(0) and Var(9) hold. Finally, for any r > 1 such that i5 |£o| r < oo, then 

e(r) = {9eM^ +1 , £>;(0)|<1}. 

i>i 

Note that if 9 G 0(r) with r > 1 then the previous conditions of stationarity Ej=o ^i-^ 5 ^ and 1 + 
E?=o a i^* 7^ for all \X\ < 1 are satisfied. 

2. GARCH(p, g) processes. 

Consider the GARCH(p, q) process defined by: 

p q 

x t = a t f t , <r t 2 = «s + E "i^t-i + E > 1 e z ( 3 ) 

with £ (£ 2 ) = 1 and 0q := (aj, ■ ■ • , a*, /3J, • • • ,/?*)€© where 9 is a compact subset of ]0, oo[x [0, oo[ p+9 such 
that a j + S?=i Pj < 1 for all 6* e 0. Then there exists (see Bollerslev [TD] or Nelson and Cao (25] ) a 

nonnegative sequence (^i(^))j>o such that cr t 2 = Vo(^o) + Ej>i ^j( d o) X t-j with ^o(^o) = "oA 1 ~ EjU 
This Droccss belongs to the class M.i.(Ma*. fa*) where fa = and Ma(xi .•••") = ,AW60 + tbAffhZ for 



9 G e > Ei=i + Ei=i ^ < Po then the sequences (||Vi(0)||e),>i, (||V>j Wlle) 3 >i and (||V"(0)||e)j>i decay 
exponentially fast (see Berkes ei aZ. [7]) and Assumption K.(fg,Mg,@) holds. Moreover, is a sequence of 
non-degenerate random variables (i.e. £f are not equal to a constant), Assumptions Id(9) and Var(9) hold. 
Finally for r > 2 we obtain 

oo 

e(r) = {0ee ; (£|eoi r ) 2/r E^w <:L }- 

2.3 The quasi-maximum likelihood estimator 

Let k > n > 2, if (A 1; --- , X fc ) 6 A4.n... m (Mg, fg), then for Tc {1, ••• the conditional quasi-(log)likelihood 
computed on T is given by: 

L(T,0):=-iX>(0) with g t (g)= (Xt ~^ )2 +log(^) (4) 

where /J = fg(Xt-i, Xt-2 ■ ■ ■ ), Mg = Mg (Xt— l > • • • ) and Tig = Mg 2 . The classical approximation of this 
conditional log-likelihood is given by: 

L(T,9):=-t-J2%(6) where q t (6) := ^ + log {%) (5) 

t£T Kg 

withfl = fg(X t _ 1 ,...,X 1 ,0,0,---), M\ = Mg(X t -i, . . . , Xi, 0, 0, • • • ) and ft* = (Ml) 2 . 

For T C {1, • • • , fc}, define the quasi maximum-likelihood estimator (QMLE) of 9 computed on T by 

0(T) := argmax(L(T, 8)). (6) 
In Bardet and Wintenberger [3] it was established that if (X\ , X n ) is an observed trajectory of X C A4z (/ej , Mgj ) 

o 

with 9q G 0(4) and if is a compact set such as Assumptions Aj(/g, Mg, 0) (or Ai(hg, 0)) hold for i = 0, 1, 2 and 
under Assumptions D(0), ld(0), Var(0), K(fg,Mg,@), then 



VE(6(T 1<n ) - 0$ A Af(0, FG^F), (7) 

with 



G := E 



%)(#5)%)(05)'l and F , = E \d 2 q (9* ) 



89 89 



8989' 



(8) 



where ' denotes the transpose and with go defined in Note that under assumptions D(0) and Var(0), G is 
symmetric positive definite (see [IB]) and F is non-singular (see [1]). Also define the matrix 

rVn 1 ^ f dqMT)) \f dq t (0(T)) y g, m 2 f d 2 L m (T,9(T)) ^ 
GiT) -=C^)^ T {^9—){^8—) ^ ^ (T) - = -C^rd(T)l 9^ )' (9) 

Under the previous assumptions, G(T l ra ) and F(Ti^ n ) converge almost surely to G and F respectively. Hence, 

V^G(T hn )- 1 / 2 F(T hn )(9(T hn )-9*) A Af(0,I d ) (10) 

71— >0O 

with the identity matrix. This result will be the starting point of the following monitoring procedure. 

3 The monitoring procedure and asymptotic results 
3.1 The monitoring procedure 

In the sequel, (X\ , ■ • • , X n ) is supposed to be the historical available observations belonging to the class M.{\ ... (fg* , Mg*). 



At a monitoring instant k, our idea is to evaluate the difference between 0(Ti^) and 9(Ti t „) for any I = n, • • • , k. 
More precisely, from (fT0|) . for any k > n define the statistic (called the detector) 

C k ,t := \\G(T hn )-^ 2 F(T hn )(d(T^ k ) - 6(T hn ))\\ 

for £ = n, ■ ■ ■ ,k. Since the matrix G(Ti jn ) is asymptotically symmetric and positive definite (see 18 ), G(Ti,„) -1 / 2 
exists for n large enough and C k £ is well defined. At the beginning of the monitoring and when £ is close to fc, the 
length of Ti^ is too small, therefore the numerical algorithm used to compute 0(Tg_k) cannot converge. This can 
introduce a large distortion in the procedure. To avoid this, we introduce a sequence of integer numbers (ji„)„ e jv 
with v n << n and compute Ck,i for £ € {n — v n , n — V n + 1, • • ■ , k — v n }. Thus, for any k > n denote 

n„, fc := {n - v n , n - v n + 1, • • • , k - v n }. 

For technical reasons, assume that, 

v n — > oo and v n /\/n — > (n — > oo). 
According to Remark 1 of [IS], we can choose v n = [(\ogn) s ] with 5 > 1. 

Note that, if change does not occur at time k > n, for any £ S Tl n ,k, the two estimators 9(Tg } k) and 9(Ti n ) are 
close and the detector Ck.e is not large enough. Hence, the monitoring stops and reject H at the first time k > n 
where there exists £ G II ni & satisfying Ck,i > c for a fixed constant c > 0. To be more general, we will use a 
b : (0, oo) i-> (0, oo), called a boundary function satisfying: 

Assumption B: b : (0, oo) i— > (0, oo) is a non-increasing and continuous function such as Inf b(t) > 0. 

0<i<oo 

Then the monitoring procedure stops at the first time k > n such as there exists £ € H n ,k satisfying Ck,i > 
b{{k — t)/n). Hence define the stopping time: 

r(n) := Inf{fc > n / 3£ e IL n , k , C k .i > b((k - £)/n)} = Infjfc > n / max u , n Ck j,, , > l}. 

1 ten n , k b{{k - l)/n) ' 

Therefore, we have 

P{r(n) < oo} = Pi max k ' 1 > 1 for some k> n \ = Pi sup max — — k ' e > 1 \. (11) 

I een„ ik b((k -l)/n) J L k> n ^n n:h b((k - l)/n) J 

The challenge is to choose a suitable boundary function &(•) such as for some given a € (0, 1) 

lim Ph {t{ti) < oo} = a 

n— >oo 

and 

lim Pf/ 1 {r(n) < oo} = 1 

71— >OG 

where the hypothesis Ho and Hi are specified in Section [TJ 

In the case where &(•) is a constant positive value, b = c with c > 0, these conditions lead to compute a threshold 
c = c a depending on a. If change is detected under H\ i.e. r(n) < oo and r(n) > fc*, then the detection delay is 
defined by 

d n — t(ti) — fc*. 

Using the previous notations, Na et al. 25 used the following detector 

D k := % AI||G'(r 1 , Tl )" 1/2 i ? (r l!Tl )(^(ri, fe ) -0(T Un ))\\. 



the procedure, the recursive estimator contents the observations X\, • • ■ , X n , • • • , Xk*-i which depends on 9q. Then, 
one must wait longer before the difference between 9{X\, ■ ■ ■ ,X n ) and 9(Xi, ■ ■ ■ ,X n , ■ ■ ■ ,Xk) becomes significant 
at a step k > k* . Therefore, their procedure cannot be effective in terms of detection delay. Moreover, if n tends 
to infinity, it is not almost sure that this change will be detected. These are confirmed by the results of simulations 
(see Section 4). 

Berkes et al. (2004) considered an estimator based on historical data to compute the quasi-likelihood scores. 
They used the fact that the partial derivatives applied to a vector u is equal to if and only if u is the true parameter 
of the model. So, when change occurs, their detector growths asymptotically to infinity. Therefore, their procedure 
is consistent. They proved this result for GARCH(p,q) models. 

3.2 Asymptotic behaviour under the null hypothesis 

Under Hq, the parameter 9q does not change over the new observations. Thus we have the result 

o 

Theorem 3.1 Assume D(Q), Id(Q), Var(Q), K(fg, Mg,Q), B and 0q e 9(4). Under the null hypothesis H , then 

v or is to/ \\W d {s) - sW d {\))\\ \ 
hm P{r(n) < oo} = P\ sup sup , — > 1 } 

jh-oo I t>1 i <s<t t b{s) J 

where Wd is a d- dimensional standard Brownian motion. 

In the simulations, we will use the most "natural" boundary function b(-) — c with c a positive constant since it 
satisfies the above assumptions imposed to &(•). In such case, the forthcoming corollary indicates that the asymptotic 
distribution of Theorem 13. II can be easily computed: 



Corollary 3.1 Assume b(t) = c > for t > 0. Under the assumptions of Theorem \3.1[ 

lim P{r(n) < oo} - p\ sup sup \\\W d {s) - sW d {\))\\ > c} - P{U d > c} 

n ^°° I- t>l Ks<t t > 



where U d = sup 0<u<1 f(u) \\W d (u)\\ with f{u) = -^L =^—^ — = (- ^ =) ' . 

V9 - u + 3yT — u ^3- u + i/(9 - u)(l - u)' 

Remark 3.1 By the law of the iterated logarithm, it comes that 

sup h\W d {s)-sW d {l))\\ ^ \\W d {l))\\. 

Ks<t t t-Hx> 

So, the two distributions sup 1<s<t i||W<j(s) — sWrf(l))|| as t — > oo (resp. t — > 1) and f(u) ||Wd(u)|| as u — > 1 (resp. 
u — > 0) are equal. It is easy to show (see proof of Corollaru \S. 1)) that 

sup sup h\W d (s) - sW d (l))\\ = sup /(u)||W d (tt)||. 

t>l Ks<t t 0<m<1 

Therefore, at a nominal level a E (0,1), take c = c(a) be the (1 — a)-quantile of the distribution of U d = 
sup 0<M<1 f(u) \\W d (u)\\ which can be computed through Monte-Carlo simulations. Table [T] shows the (1 — a)- 
quantile of this distribution for a = 0.01, 0.05, 0.10 and d = 1, • • ■ ,5. 



d=l d=2 d=3 d=A d=5 

a = 0.01 2J583 31)35^ 3^335 3^ 3J14" 

a = 0.05 1.954 2.432 2.760 3.073 3.334 

a = 0.10 1.652 2.156 2.486 2.784 3.028 



Table 1: ErriDirical (1 — aVcmantilc of the distribution of Uj. for d = 1. 



.5. 



3.3 Asymptotic behaviour under the alternative hypothesis 

Under the alternative Hi, the parameter changes from 6*q to 0\ at k* > n, where 9\ g and 9$ ^ 9\. Then 
Theorem 3.2 Assume D(Q), Id(Q),Var(Q), K(fg, Mg,Q) and B. Under the alternative Hi, if 91 ^ 9^ and 

o 

9q,91 e 0(4) then for k* = k*(n) such as \va\s\yp n ^ roo k*(n)/n < oo and k n — k*(n) + n s with S G (1/2,1), 

Ck„,l a.s. 

OO. 



^6n„, fc „ b((k n - £)/n) n - 
The forthcoming Corollary 13.21 can be immediately deduced from the relation (fTTj) . 
Corollary 3.2 Under assumptions of Theorem \3.2\. 

lim P{r(n) < oo} = 1. 

n— >qg 

Remark 3.2 We know that the monitoring is stopped and rejects Ho at the first time k where 

max — '—— — > 1. 

<?en„, fe b((k - l)/n) 

Therefore, it follows from Theorem \3.2\ that under the hypothesis Hi , the detection delay d n of the procedure can be 
bounded by Opin 1 /^ 6 ) for any e > (or even by Op (-^(log n) a ) with a > using the same kind of proof). 

3.4 Examples 

3.4.1 AR(oo) processes 

Consider the generalization of ARMA(p, q) processes defined in ([2]) i.e. a AR(oo) processes defined by: 

X t = M0*o) + E MWK-i + 6 , * € Z (12) 
J">1 

o 

with 9q G0, where we can chose as a compact subset of 0(4) C M where 

9(4) = {0 e M d ; <!}■ 

i>i 

This process belongs to the class Mz(Mg* , /#*) where fe(xi, ■ ■ ■ ) = J2j>i < l ) j(^) x j and Me = 4>o{&) f° r all 9 6 
and therefore af\fe,@) = \\<t>j{8)\\& and af ] {M e ,Q) = for j e N* . Then 

• Assumption D(0) holds if h = inf (\<j> {0)\) > 0; 

• Assumption K(/#,M0,0) holds if there exists £ > 2 and and if i— >■ (pj(0) are twice differentiable functions 
satisfying max (||^(0)||e, H' 3 (0)\\e, U"(0)\\e) = 0(j-«) for j e N. 

• if (£t) is a sequence of non-degenerate random variables (i.e. £t are not equal to a constant), Assumptions 
ld(0) and Var(0) hold. 

Case of AR(p) process 

Assume that 

p 

*t = <t>t + Yl + & with P e M *- 

The true parameter of the model is denoted by #q = (</>g,0f,--- ,(/>*) € where = {9 = {</>o,<j>i,' •• ,<t>p) G 



for any t = 1, • • • , k and € 8 we have, q t {0) = (X t - (f> - ^j x t-j) , t Q = -2(X t - <f> - ^3 X t- 3 ) ■ 

3 = 1 m 3 = 1 

{l,X t -uX t -2,--- ,I t -p). Moreover, = 2, for j = 1, • • • ,p, = 2X t ^ and for 1 < i,j < p, 

d%(0)_ OY y 

— AJi.t-iJi.t-j- 



3.4.2 ARCH(oo) processes 

Consider the generalization GARCH(p,g) processes defined in © i.e. a ARCH(oo) processes defined by: 

oo 

X t = a t ^ and a\ = yj (0* ) + £ 4>i % ) x l- 3 >t&Z (13) 

3 = 1 

o 

with 0q €0, where we can chose as a compact subset of 8(4) C M where 

oo 

e(4) = {0elR d ; (^|Co| 4 ) 1/2 ^|0,(^)| < I}- 

3 = 1 

This process, introduced by Robinson [35] , belongs to the class Mz(fe*, Mg* , ) where fe(%i,-") = an d Mg [xi,---) = 
M d ) + Ej>i^jW^ for all G and therefore af\f e ,Q) = and af\hg,Q) = ||0j(0)||e for j € W* (X is of 
course a ARCH- type process). Then 

• Assumption D(8) holds if h = inf(V>o(0)) > 0; 

• Assumption K(/^,Af^,B) holds if there exists £ > 2 and and if 9 i— ► <£j(0) are twice differentiate functions 
satisfying max (||^(0)||e, ll^Wlle, HV^'WIle) = 0{j~ l ) for j e N. 

• if (£ 2 ) is a sequence of non-degenerate random variables (i.e. £ 2 are not equal to a constant), Assumptions 
Id(8) and Var(8) hold. 



Case of GARCH(1, 1) process 

Assume that 

Xt = crtdt w hh of = + a*X t _ 1 + (3la t -i 
with #o = (aJ,a*,/3*) e 8 c]0, oo[x [0, oo[ 2 and satisfying a* + f)* < 1. The ARCH(oo) representation is cr| = 

Q!o/(l - + a* S (PiV^Xt-i- ^ a trajectory (Ai, • • • , A fc ) has been observed, for any t = 1, • • • , k and e 8 

i>i 

we have, 

t 

% = ao/(l - ft) + a 1 A 2 _ 1 + ttl £ ft^X*^ and &(0) = A t 2 / fc* + log(^). 

3=2 

m , . „ „ , dq t (9) 1 / X^/dhi dhl dhi\ , dh% „ * „ dhi 

Thus, it follows that = 57 (l - ?r) ( fl"^' fl"^' «/) with = + £ # = 11 ~ ^ ' 



9ag 



9/?* 

and = a /(l - ft) 2 + axA 2 _ 2 (j - l)^ 2 ** 2 -*- 

dpi j=3 

Let = (ao,ai,/?i) = (#1,02,03) € 8, for 1 < i, j < 3, we have 

d 2 g t {0) _ 1 /2A 2 \dhl_dhl J_/ A 2 \ 9 2 ^ 

90^07 ~ vir ~ X J a0j + I 1 ~ ^rj 



3.4.3 TARCH(oo) processes 

The process X is called Threshold ARCH(oo) (TARCH(oo) in the sequel) if it satisfies 



oo 

X t = o*£t and a t = b (9* ) + ^ [b+(9* ) max(AV„ 0) - 67(0*) mm(X t ^, 0)] , t € Z (14) 

-4- — 

where the parameters bo(9), bj{6) and 6^ (0) are assumed to be non negative real numbers and 9 £Q where is a 
compact subset of 6(4) where 

oo 

Q(4) = [deM d / (E\^) 1/4 J2^(bj(0),b+(6)) < l} 

3=1 

since aj ' (M, {0}) = max (b~(0), 6j~(0)) . This class of processes is a generalization of the class of TGARCH(p,q) 
processes (introduced by Rabemananjara and Zako'ian |27j). Then, 

• Assumption D(6) holds if h = infg G e b a {9) > 0; 

• Assumption K(/g, Mg, 6) holds if there exists £ > 2 and and if 9 M> bj(0) and 9 \-> bj(6) are twice differentiable 
functions satisfying 

d d d 2 _ , „ „ d 2 

-3 win»m^ v/iiT».n^i Wile, (»)||e, H^ftJ""" 



ma X (||&-(0)||©, ||6+^)|| ,|| 6 T ( e)|| e , || fo+ (^) || e , || & j (0) || e , || 6 +(^) || e ) = 0(j- £ ) for j £ IN. 



Unfortunately, for TARCH(oo) it is not possible to provide simple conditions for obtaining Assumptions ld(0) and 
Var(9) as for AR(oo) or ARCH(oo) processes. 

4 Some simulation and numerical experiments 

First remark that, at a time k > n, we need to compute Ck,i for all £ £ H n ,k to test whether change occurs or not. 
On can see that, the computational time is very long and increases with k. To reduce it, we introduce an integer 
sequence (u n ) (satisfying u n /y/n — > as n — > 00; typically u n = [ln(n)]) and compute Ck,t only for 

£ E n" fe := {n — v n ,n — v n + u n ,n - v n + 2u n , ■ • • ,k— v n }. 

We have 11° k C ^ n ,k and for any t = — with £ £ H n ,k, we can find an integer jg such that n — v n + jgu n £ 11° k 
and n - v n + j e u n < £ < n - v n + (j e + l)u n . This implies that < t < "~ t, "+^ tt " + ^ . Thus, we have 

asymptotically (as n — > 00), t ~ _ ft shows that the previous asymptotic results still hold by computing 

Ck.e for £ £ 11° k . The condition u n /yfn — > ensures that the Theorem 13.21 still holds by choosing k n = k*(n) + n s 
with 5 £ (1/2,1). In practice, the use of 11° k can introduce a distortion in the detection delay. But, the new 
detection delay must be between d n and d n + u n (where d n is the detection delay obtained by using H n .k)- In the 
sequel, we use u n = [ln(n)]. 

Moreover, if b = c > is a constant function, according to (flT]) . we have 

PWiri) < 00} = P< sup max C^f > cL (15) 
L k> n ' > 

Thus, denote 

Cfe = max Cfc £ for any k > n. 

The procedure is monitored from k = n+l to k = n + 500. The set {n + 1, • • • , n + 500} is called monitoring period. 

According to the Remark 1 of [18], v n = [(logn) 5 ] (with 1 < 5 < 3) is chosen. We evaluated the performance of the 
— n „„A „. _ n — ,„i rn — „N3/2i 171 — ,„n2i rn \3i „„j „. „,„, — j +„ „. _ rn \3/2i f — u — „_ 



a-) C k for GARCH(1,1) without change 



b-) C k for GARCH(1 ,1 ) with one change at k*=750 




500 600 700 800 900 1000 500 600 700 800 900 1000 

k k 



Fi gure 1: Typical realization of the statistics Ck for n — 500 and k — 501, • • • , 1000. a-) The parameter 8q — 
(0.01,0.3,0.2) is constant ; b-) the parameter 6* = (0.01,0.3,0.2) changes to Q\ = (0.05,0.5,0.2) at k* = 750. The 
horizontal solid line represents the limit of the critical region, the vertical dotted line indicates where the change 
occurs and the vertical solid line indicates the time where the monitoring procedure detecting the change. 

4.1 An illustration 

We consider GARCH(1,1) process : X t — <7t£t with of = + a* 1 X^_ 1 + p*a^_ x . Thus, the parameter of model 
is 6q = (ajj, a\, PI). The historical available data are X-y, ■ ■ ■ ,^500 (therefore n = 500) and the monitoring period 
is {501, • • • , 1000}. At the nominal level a — 0.05, the critical values of the procedure is C a — 2.760. The Figure [T] 
is a typical realization of the statistic (Cfc)5oo<fc<iooo- We consider a scenario without change (Figure Q] a-)) and a 
scenario with change at k* = n + 250 = 750 (Figure[TJb-)). Figure[T]a-) shows that, the detector Ck is bellow under 
the horizontal line which represents the limit of the critical region. On Figure [T]b-) we can see that, before change 
occurs, Ck is bellow under the horizontal line and increases with a high speed after change. Such growth over a long 
period indicates that something happening in the model. 

4.2 Monitoring mean shift in times series 

Let (X±, ■ ■ ■ ,X n ) be an (historical) observation of a process X = (X t )tez- We assume that X satisfy 

( X t =fi + e t for 1 < t < k* 
\ X t — fix + e t for t > k* 

with k* > n, jiQ ^ fii and (et) a zero mean stationary time series belongs to a class A4z{fe, Me)- Under Hq, 
k* = 00. The monitoring procedure start at k = n + 1 and the aim is to test mean shift over the new observation 
X n _|_i, X n+ 2, • • • • This problem can be see as monitoring changes in linear model (see Horvath et al. |16j . Aue et al. 
[2]) with constant regressor. The empirical mean 

1 n 



is a consistent estimator of /zq. The recursive residual is defined by 



e k = X k - X n ; for fc > n. 



Horvath et al. [T^ and Aue et al. [5] proposed the detector 



1 1 



k 



Qk 



5 n^)(l-f)^ 



E £i| k > n; c > 0; < 7 < 1/2 



i—n+l 



where ct^ 



is an consistent estimator of the long-run variance 



lim — Var(y ej). 



n— >oo XI — 



If the process (et) are uncorrelated (for instance G ARCH- type model), empirical variance of the historical data can 
be used as estimator of a 2 . If (e t ) are correlated, the popular Bartlett estimator (see [5]) can be used. Under some 
regular conditions, it hold that (see [TB] and [5]) 



Hence, at a nominal level a — 0.05, the critical value of the test is the (1 — a)-quantile of the distribution of 
sup ||H / i(s)||/s 7 . When 7 = 0, these quantiles are known (see Table 1 of [25] for values obtained through a Monte 

0<s<l 

Carlo simulation). 

We compare our procedure to the previous residuals CUSUM one (with 7 = 0) in two situations 

1. (e t ) is an AR(1) process; e t = <fi*e t -i + & with 0* = 0.2; 

2. (e t ) is a GARCH(1, 1) process; e t = cr t £ t with a 2 t = a% + a\e^_ x + ^t-i and ("o> a i^D = (0.01,0.3,0.2). 

The historical sample size are n — 500 and n — 1000. These procedure are evaluated at times k = n + 100, n + 
200, n + 300, n + 400, n + 500, while the change occurs at fc* = n + 50 or k* = n + 250. Tables [2] and [3] indicate 
the empirical levels and the empirical powers based of 200 replications. The elementary statistics of the empirical 
detection delay are reported in Tables |U 

The results of Table [5] and Table [3] show that both procedure based on detectors C k and Q k are more conservative. 
One can also see that, increasing length n of historical data reduces the size distortion of these procedures. This is 
due to the fact that the length of monitoring period is fixed and not increasing with n. 

Under Hi, the change has been detected before the monitoring time k — n + 500. But, as we mentioned above, the 
challenge of this problem is to minimize the detection delay. For this criteria, it is seen in Table @] that for the mean 
shift in AR process, our procedure works well as Horvath et al. 's procedure when the change occurs at the beginning 
of the monitoring (fc* — n + 50) and it is little better when the change occurs long time after the beginning of the 
monitoring (fc* = n + 250). For the mean shift in GARCH process, our test procedure outperforms the Horvath et 
al. 's test in terms of mean, Qi, median and Q3 of detection delay. 

4.3 Monitoring parameter change in AR(1) and GARCH(1,1) models 

In this subsection, we present some simulations results for monitoring parameter change in AR(1) and GARCH(1,1) 
models and compare our procedure to that proposed by Na et al. |25j . First recall that if the boundary function 
b = c > is constant, this procedure is based on the relation 
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Qk 


0.000 


0.000 


0.005 


0.000 


0.010 


Empirical powers 


n = 


-- 500 


k* = n + 50 


Ck 


0.310 


1 


1 


1 












Qk 


0.335 


1 


1 


1 






n = 


500 ; 


k* = n + 250 


Ck 


0.000 


0.000 


0.190 


1 












Qk 


0.000 


0.000 


0.130 


0.965 






n = 


1000 


; k* = n + 50 


Ck 


0.075 


1 


1 


1 












Qk 


0.095 


1 


1 


1 






n = 


1000 


k* = n + 250 


Ck 


0.000 


0.000 


0.135 


1 












Qk 


0.000 


0.000 


0.075 


0.980 





Table 2: Empirical levels and powers for monitoring means shift in AR(1) with <f>\ = 0.2. The empirical levels arc computed when 
fio = and the empirical powers arc computed when the mean /iq = changes to fi\ = 1.2. 









k 


n + 100 


n + 200 


n + 300 


n + 400 


n + 500 


Empirical levels 




n = 500 


Ck 


0.005 


0.015 


0.030 


0.055 


0.060 








Qk 


0.000 


0.000 


0.005 


0.010 


0.010 






n = 1000 


Ck 


0.000 


0.005 


0.005 


0.010 


0.015 








Qk 


0.000 


0.000 


0.000 


0.010 


0.010 


Empirical powers 


n = 


= 500 ; k* = n + 50 


Ck 


1 


1 


1 












Qk 


1 


1 


1 








n = 


500 ; k* = n + 250 


Ck 


0.010 


0.015 


1 












Qk 


0.000 


0.000 


0.920 








n = 


1000 ; k* = n + 50 


Ck 


0.995 


1 


1 












Qk 


0.985 


1 


1 








n = 


1000 ; k* =n + 250 


Ck 


0.000 


0.000 


0.980 












Qk 


0.000 


0.000 


0.765 







Table 3: Empirical levels and powers for monitoring means shift in GARCH(1,1) with (aJ$,a!*,/8*) = (0.01,0.3,0.2). The empirical 
levels are computed when fig = and the empirical powers are computed when the mean /iq = changes to fii = 0.3. 
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SD 
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KA 7/1 
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1 c 
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44 
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Qk 


53.78 


14.72 


16 


43 


54 


63 


102 




n = 500 ; k* = n + 250 


Ck 


63.14 


23.18 


12 


45 


61 


77 


135 






Qk 


72.70 


21.47 


7 


56 


71.5 


90 


139 




n = 1000 ; k* = n + 50 


Ck 


75.84 


14.19 


37 


66 


75 


83 


114 






Qk 


72.60 


13.23 


41 


63 


73 


82 


111 




n = 1000 ; k* = n + 250 


Ck 


76.24 


19.15 


23 


60 


76 


89 


140 






Qk 


86.82 


22.57 


27 


70 


85 


100 


151 


GARCH(1,1) 


n = 500 ; k* = n + 50 


Ck 


20.21 


6.15 


1 


16 


20 


24 


35 






Qk 


27.06 


4.52 


16 


24 


27 


30 


44 




n = 500 ; fc* = n + 250 


Ck 


25.53 


8.04 


3 


20 


25 


31 


50 






Qk 


35.40 


10.01 


13 


28 


35 


41 


62 




n = 1000 ; k* = n + 50 


Ck 


28.43 


7.41 


6 


24 


28 


33 


51 






Qk 


36.98 


5.09 


21 


33 


37 


40 


48 




n = 1000 ; k* = n + 250 


Ck 


31.16 


8.52 


4 


26 


33 


39 


53 






Qk 


44.35 


10.04 


14 


37 


45 


50 


71 



Table 4: Elementary statistics of the empirical detection delay for monitoring mean shift in AR(1) and GARCH(1,1). 



where 

D k := ^||G(Ti )n )-V 2 F(Ti in )(fl(T ljfc ) -^(Ti, n ))||. 

Na et al. show that under H , 

lim P{r(n) < 00} = lim p{ sup D k > c) = p{ sup ||W d (s)|| > cX. 

n^oo n^oc I k>n J I 0<s<l > 

Hence, at a nominal level a, the critical value of their procedure is the (1 — a)-quantile of the distribution of 
sup ||Wd(s)|| which can be found in Table 1 of [25] . 

0<s<l 

The comparisons are made in the followings situations. 

1. For AR(1) model : X t = (ftXt-i + & ■ Under H , 6 Q = = 0-2. Under H u 9 changes to a = -0.5 at k* . 

2. For GARCH(1, 1) model : X t = a t & with a 2 t = a* + alXf_ t + /3$a%_ v Under H , 9 Q = (a%,c4,Pl) = 
(0.01, 0.3, 0.2), while under H x , O = (0.01, 0.3, 0.2) changes to 6 1 = (0.05, 0.5, 0.2) at k* . 

The historical sample size are n — 500 and n — 1000. These procedure are evaluated at times k = n + 100, n + 
200, n + 300, n + 400, n + 500, , while the change occurs at k* = n + 50 or k* = n + 250. Tables [5] and EO indicate 
the empirical levels and the empirical powers based of 200 replications. The elementary statistics of the empirical 
detection delay are reported in Tables [7] 
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n + 100 


n + 200 


n + 300 


n + 400 


n + 500 


Empirical levels 




n = 500 






0.000 


0.000 


0.010 


0.010 


0.035 










D k 


0.000 


0.000 


0.000 


0.000 


0.025 






n = 1000 




c k 


0.000 


0.000 


0.000 


0.010 


0.025 










D k 


0.000 


0.000 


0.000 


0.000 


0.020 


Empirical powers 


n = 


= 500 ; k* = n - 


h50 


c k 


0.335 


1 


1 


1 


1 










Dk 


0.175 


0.985 


1 


1 


1 




n = 


500 ; k* = n -+ 


250 


c k 


0.000 


0.000 


0.180 


990 


1 










D k 


0.000 


0.000 


0.095 


0.865 


1 




n 


1000 ; k* =71 


1-50 


c k 


0.065 


0.995 


1 


1 


1 










D k 


0.090 


0.975 


1 


1 


1 




n = 


1000 ; k* = n- 


h250 


c k 


0.000 


0.000 


0.140 


0.990 


1 










D k 


0.000 


0.000 


0.075 


0.855 


0.995 



Table 5: Empirical levels and powers for monitoring parameter change in AR(1) process. The empirical levels are computed when 
#0 = <t>i = 0.2 is constant and the empirical powers are computed when 80 = 0.2 changes to 6\ = —0.5. 



The considered AR and GARCH processes have zero mean. Contrary to the mean shift studied above, this 
mean is not estimated. For AR model, it appears in Table [5] that both procedures based on detector C k and D k 
are conservative. This is not the case for GARCH model (Table [S]). The high size distortions when n = 500 is due 
to the difficulty to estimate the parameter of GARCH model. This size distortion decreases when n increases and 
Corollary 13.11 ensures that with infinite monitoring period, the empirical level tends to the nominal one as n — > 00. 

For both the cases of AR and GARCH processes, the procedure based on detector C k detect the change after 
the monitoring time k = n + 500. Unlike Na et al. [25] . we consider a scenario of GARCH model with moderate 
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k 


n + 100 


n + 200 


n + 300 


n + 400 


n + 500 


Empirical levels 


n 


= 500 


Ck 


0.010 


0.025 


0.040 


0.095 


0.105 








D k 


0.010 


0.015 


0.040 


0.040 


0.055 




n 


= 1000 


Ck 


0.000 


0.000 


0.030 


0.045 


0.055 








D k 


0.000 


0.000 


0.010 


0.015 


0.035 


Empirical powers n = 


-- 500 


k* = n + 50 


Ck 


0.890 


1 


1 


1 


1 








D k 


0.390 


0.855 


0.930 


0.965 


0.985 


n = 


500 ; 


k* = n + 250 


Ck 


0.010 


0.030 


0.825 


1 


1 








D k 


0.010 


0.020 


0.270 


0.805 


0.915 


n = 


1000 


; k* = n + 50 


Ck 


0.835 


1 


1 


1 


1 








D k 


0.310 


0.970 


0.990 


0.995 


0.995 


n = 


1000 


k* = n + 250 


Ck 


0.000 


0.005 


0.685 


1 


1 








D k 


0.000 


0.000 


0.250 


0.955 


0.990 



Table 6: Empirical levels and powers for monitoring parameter change in GARCH(1,1) process. The empirical levels are computed 
when 6*o = (ag,a*,/9*) = (0.01,0.3,0.2) is constant (hypothesis Hq) and the empirical powers are computed when 6q = (0.01,0.3,0.2) 
changes to 0i = (0.05,0.5,0.2) (hypothesis #i). 
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Mean 


SD 


Min 


Qi 


Med 


Q 3 


Max 


AR(1) 


n = 500 


k* = n + 50 


Ck 


55.36 


18.75 


9 


42 


56 


67 


121 








D k 


71.54 


38.44 


2 


52.75 


69 


89 


167 




n = 500 ; 


k* = n + 250 


Ck 


66.81 


25.27 


5 


49 


65 


83 


149 








D k 


97.80 


39.42 


21 


68 


89 


123 


222 




n = 1000 


; k* = n + 50 


Ck 


75.13 


19.87 


24 


62 


74 


90 


147 








D k 


87.70 


28.72 


14 


66 


85 


109 


195 




n = 1000 


k* = n + 250 


Ck 


76.89 


26.16 


15 


56 


77 


96 


172 








D k 


101.20 


37.97 


20 


75 


96 


129 


245 


GARCH(1,1) 


n = 500 


k* = n + 50 


Ck 


29.41 


15.84 


4 


22 


31 


40 


98 








D k 


86.05 


90.50 


2 


36 


61 


99 


416 




n = 500 ; 


k* = n + 250 


Ck 


38.02 


19.33 


5 


27 


37 


44 


113 








D k 


87.72 


50.96 


1 


49.25 


79 


112 


236 




n = 1000 


; k* = n + 50 


Ck 


41.96 


13.93 


3 


32 


41 


48 


94 








D k 


71.29 


37.12 


6 


46 


66 


88 


287 




n = 1000 


k* =n + 250 


Ck 


44.99 


17.16 


5 


35 


41 


52 


117 








D k 


75.78 


35.10 


7 


52 


71 


95 


198 
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is not surprising according to the comment of subsection 13.11 

Table [7] indicates the distribution of the detection delay d n . We can see in Table [7] (even in Table [4J that 
for our procedure, the relation diooo < ^1000/500 g?5oo is globally satisfied (from Theorem 13.21 we deduced that 
d n = Opiii 1 !" 1 logn) when is large enough). It is also seen that, mean, Qx, median and Qz of our test are shorter 
than Na et aVs one. The results of Table El |6] and [7] show that, our test is uniformly better and the procedure based 
on detector C k is highly recommended. 

5 Real-Data Applications 

We consider the returns of the daily closing values of the Nikkei 225 stock index (from January 2, 1995 to October 
19, 1998), S&P 500 and FTSE 100 (from January 2, 2004 to June 11, 2012). These data are available on Yahoo! 
Finance at |http : //f inance . yahoo . com/[ They are represented on Figure [2] and Figure [6j These series are known 
to represent ARCH effect and GARCH(1,2) (resp. GARCH(1,1)) can be used to capture it in returns of Nikkei 
225 (resp. S&P 500 and FTSE 100), see the book of Francq and Zako'ian 2010. Let us take the observations going 
from January 2, 1995 to December 31, 1996 (resp. January 2, 2004 to December 30, 2005) as a historical data 
for the Nikkei 225 (resp. S&P 500 and FTSE 100) stock index. These periods are known to be stable in financial 
community. To verify it, we apply three procedures to test for parameter change in the historical observations. The 
null hypothesis is that the parameter is constant over the observations against the parameter changes alternative. 

• The first test is proposed by Kengne [18] . Define the asymptotic covariance matrix (which take into account 
the change possibility) of the estimator n (Ti^ n ) by 

^n,k '■— —F n (Ti,k)Gn(Ti,k) 1 ^ 1 "('^l,*-')ldct(G„(T 1 , fc ))#0 ~l ~ F n (Tk,n)G n (T ktn ) 1 -p7i(^fc,n)l ( j e t(S„(Tj Si „))^0' 

The test is based on the statistic 

Q n :=max(Q£\g£9) where 
Q« := max with q£\ := — (9 n (T lik ) - 6 n {T n j)'% k (d n {T k ) - 6 n (T n )), 

v n <k<n—v n ' Jl 

■= max qP\ with := ( " ~ ^ (0 n (T k , n ) - 6 n (7i in )) '^n,k(0n (Tfc.n) - n (T k , n )). 

v n <k<n—v n ' ' Tl 

This test is applied with v n — (logn) 6 where 2 < 5 < 5/2. 

• The second test (see Lee and Song [35]) is based on the statistic 

Q [ n ] ~ max (—(e n (Ti, h ) - ^„(T 1)n ))'S„ !n (^(Ti ifc ) - n (T lin )) ) 

v n <k<n-v n \ n J 

with v n = (logn) 2 . 

• The third procedure is the CUSUM test see Kulperger and Yu [2Tj . 

At a nominal level a g (0, 1), each of these procedure rejects null hypothesis if the test statistic is greater than a 
critical value C a . Table [H] provides the results of these tests to the historical data that we have chosen. 









CUSUM 


Nikkei 225 


3.35 (3.98) 


2.31 (3.45) 


0.98 (1.36) 


S&P 500 


2.13 (3.47) 


2.01 (3.06) 


0.93 (1.36) 


FTSE 100 


1.95 (3.47) 


2.31 (3.06) 


1.13 (1.36) 



Table 8: Results of test for parameter changes in the historical data of Nikkei 225 (from January 2, 1995 to December 31, 1996), S&P 
500 and FTSE 100 (from Januarv 2. 2004 to December 30. 2005*). Fieurcs in brackets the critical values of the Drocedure at the nominal 



Note that, these series are very closed to a nonstationary process, in the sense that J2j=i a j + TTj=\ fij — 1 ( see 
©). Therefore, it would be difficult to compute the estimator 9 n (Tk : i) (1 < k < I < n). For the statistics Q n and 
Q\i \ we consider only the time k that the computation of 6 n (T\^k) and 6 n {Tk, n ) converges. This certainly introduces 
distortions on these tests. On the other hand, the CUSUM procedure needs to compute only the estimator 9 n (Ti, n ) 
which convergence is obtained. According to these results, we conclude that the parameter does not change over 
these historical observations. 

For Nikkei 225 data, monitoring starting at January 2, 1997. Figure [5] shows the realization of the sequence (Ck) 
for k going from January 2, 1997 to October 19, 1998. Monitoring procedure stops at October 27, 1997. Recall 
that, the monitoring scheme can be used as an alarm system. When it triggered, we need to apply retrospective 
test to estimate the breakpoint. According to Kengne [18], the test based on Q n and Qn ^ are more powerful than 
the CUSUM test. Thus, in the retrospective procedure, we applied these two tests and considered the one which 
provides more significant result (in terms of p- value). 

Retrospective procedure is applied to the observations going from January 2, 1995 to October 27, 1997 and break is 
detected at — September 17, 1997; see Figure[2j This change corresponds to the Asian financial crisis (1997-1998) 
where the turmoil period started at July 1997. 

We are going to see for S&P 500 and FTSE 100 data how multiple changes can be monitored. For these series, 
monitoring starts at January 2, 2006. Figure [3] represents the sequence (C&) for k going from January 2, 2006 to 
December 31, 2008. According to the Figure[3j the monitoring stops at November 16, 2007 and September 4, 2007 
for S&P 500 and FTSE 100 data respectively. Retrospective procedure is applied to the series going from January 
2, 2006 to November 16, 2007 (for S&P 500 data) and the series going from January 2, 2006 to September 4, 2007 
(for FTSE 100 data). Breaks are detected at t s ,i ~ June 18, 2007 (for S&P 500 data) and t F ,i ^ July 6, 2007 (for 
FTSE 100 data); see Figure [6] These breaks correspond to the beginning of the Subprime Crisis in US. 
After monitored the first change, we need to update the procedure. The new historical data are the series going 
from t s ,i to November 16, 2007 (for S&P 500 data) and the series going from t F ,i to September 4, 2007 (for FTSE 
100 data). Therefore, monitoring continues at November 19, 2007 (for S&P 500 data) and at September 5, 2007 
(for FTSE 100 data). Figure |4] shows the curve of the sequence (Ck)- The monitoring stops at October 17, 2008 
and November 10, 2008 for S&P 500 and FTSE 100 data respectively. The retrospective test is applied and the 
break point estimation are ts,z — August 14, 2008 and t F ,2 — September 17, 2008 respectively for these two series; 
see Figure |6] These breaks correspond to the Lehman Brothers Bankruptcy which affects the worldwide financial 
system. 

After that, the procedure is updated and monitoring continues at October 20, 2008 and November 11, 2008 for 
S&P 500 and FTSE 100 data. Figure [5] shows the sequence (C k ). The monitoring stopped at March 17, 2009 (S&P 
500) and March 9, 2009 (FTSE 100) and retrospective test detected change at t s ,3 - January 5, 2009 (in S&P 
500) and t Ft s ~ December 29, 2008 (in FTSE 100 data); see Figure El These breaks correspond to the worldwide 
governments intervention to solve the financial crisis. 

The procedure continues until June 2012, other breaks are detected at ts,4 — 26 June 2009, ts,5 — 5 April 2010, 
t s ,6 - 27 September 2010, t SJ ~ 19 July 2011, t s ,a ^ H January 2012 (for S&P 500 data) and t FA ~ 30 June 
2009, t F ,s ^ 27 July 2011, t Fj6 ^ 21 December 2011 (for FTSE 100 data). They are represented on Figure[6] These 
breaks correspond to the turmoils periods in the 2010 — 2012 + Greece and European debt crisis. 

Summary of the real-data applications 

Both monitoring procedure (based on detector Ck) and retrospective test have been applied to detect breaks in the 
Nikkei 225, S&P 500 and FTSE 100 stock index. The following results are obtained : 

1. For the Nikkei 225, from January 2, 1995 to October 19, 1998 ; break is detected at 



See also Figure [5] 

2. For the S&P 500 and FTSE 100, from January 2, 2004 to June 11, 2012 ; break are detected at (t Sti and t F<i 
are referred to the breakpoint in the S&P 500 and FTSE 100 respectively) 

• is i ~ 18 June 2007 and tp t i ~ 6 July 2007 which correspond to the beginning of the Subprime Crisis in 
US; 

• ts,2 — 14 August 2008 and tp,2 — 17 September 2008 which correspond to the Lehman Brothers 
Bankruptcy; 

• ts,3 — 5 January 2009 and ij?3 ~ 29 December 2008 which correspond worldwide governments intervention 
to solve the financial crisis; 

• t s ,4 ^ 26 June 2009, t s>5 ~ 5 April 2010, f s , 6 ^ 27 September 2010, t S j ~ 19 July 2011, t s>s - H 
January 2012 and t FA ~ 30 June 2009, t F>5 ~ 27 July 2011, t Fj6 ~ 21 December 2011. These breaks 
indicates the turmoils periods in the 2010 — 2012 + Greece and European debt crisis. 

See also Figure [51 

6 Conclusions 

This paper is devoted to the sequential change-point detection in the parameters of a large class of causals models. 
We construct a monitoring scheme based on a difference between the historical parameter estimate and the updated 
parameter estimate computed without the historical observations. The simulation results for the monitoring mean 
shift in AR(1) and GARCH(1,1) show that our procedure works well (in terms of power and detection delay) as 
Horvath et al. 's procedure when the change occurs at the beginning of the monitoring and it is preferable when the 
change occurs long time after the beginning of the monitoring. The simulation results for the monitoring parameter 
change in AR(1) and GARCH(1,1) show that our procedure outperforms (in terms of power and detection delay) 
the Na et al.'s one. The real-data study shows the applicability of the procedure on the daily closing values of the 
Nikkei 225, S&P 500 and FTSE 100 stock index. It is shown how this monitoring scheme with retrospective test 
can be used to off-line multiple breaks detection. 
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Breaks detection in the Nikkei 225 




Figure 2: The top figure is a realization of the statistics Ck with k going from January 2, 1995 to October 19, 1998 
for Nikkei 225 data; the historical data considered are the series going from January 2, 1995 to December 31, 1996. 
The horizontal solid line represents the limit of the critical region, the vertical dotted line indicates the date of the 
beginning of the Asian financial crisis (1997-1998) and the vertical solid line indicates the time where the monitoring 
procedure will stop. The bottom figure is the returns of Nikkei 225 data from January 2, 1995 to October 19, 1998; 
the vertical solid line indicates the date where break have been detected using retrospective test after the monitoring 
stops. 



C k for the S&P 500 





Figure 3: Realization of the statistics Ck with k going from January 2, 2006 to December 31, 2008 for S&P 500 
and FTSE 100 data; the historical data considered are the series going from January 2, 2004 to December 30, 2005. 
The horizontal solid line represents the limit of the critical region, the vertical dotted line indicates the date of the 
beginning of the Subprime Crisis in US and the vertical solid line indicates the time where the monitoring procedure 
stopped. 
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Figure 4: Realization of the statistics Ck for S&P 500 and FTSE 100 data; the historical data are the series going 
from June 18, 2007 to November 16, 2007 (for S&P 500 data) and July 6, 2007 to September 4, 2007 (for FTSE 
100 data). The horizontal solid line represents the limit of the critical region, the vertical dotted line indicates the 
date of the Lehman Brothers Crisis and the vertical solid line indicates the time where the monitoring procedure 
stopped. 




Figure 5: Realization of the statistics Ck for S&P 500 and FTSE 100 data; the historical data are the series going 
from August 14, 2008 to October 17, 2008 (S&P 500) and September 17, 2008 to November 10, 2008 (FTSE 100). 
The horizontal solid line represents the limit of the critical region, the vertical dotted line indicates the date of the 
beginning of stabilization in financial system due to the worldwide governments intervention and the vertical solid 
line indicates the time where the monitoring procedure stopped. 

7 Proofs of the main results 

Let us prove first some useful lemmas. In the sequel, for any x S -ff?, [a;] denotes the integer part of x. Let (ipn)n 
and (r n ) n be sequences of random variables. Throughout this section, we use the notation ip n — op(r n ) to mean : 
for all e > 0, P(\ip n \ > £ \ r n\) — > as n —> oo. Write ip n = Op(r„) to mean : for all e > 0, there exists C > such 
that PdV'nl > C| r n|) < £ ior n large enough. 

Recall that (Xi, • • ■ , X n ) is an observed trajectory of a process A4z(Mo*, /ej)- 

Let k > n > 2 and Ti,„ = {1, • • • , n}, Tg^ = {£, £ + 1, • • • , k} with £ € H nt k — {v n , v n + 1, - • • , k — v n }, and define 

C k , e := V^^\\G- 1/2 F ■ (9(T ltk ) -fl(T lin ))||, 

with 8 defined in ([5]). 

Lemma 7.1 Under assumptions of Theorem \3.1[ 

1 

sup max — 

k> n ^en„. fe b((k-£)/n) 

Proof. For any n > 1, we have 

sup max 1 A C k ,e - C k .e\ = . c 1 , , \ sup max \C k ,i-C k ,i 

fc >„ ^en„, fc b((k-£)/n) [ 1 mf s>0 6(s) fc> „ een n . k 1 

Now, proceed similarly as in the proof of Lemma 5.3 of [T5] . 



sup max — — \Ck,i ~ CkA — Op(l) as n — > oo. 



Breaks detection in the S&P 500 




Figure 6: Break detection in the returns of S&P 500 and FTSE 100 data using monitoring procedure based on Cfe. 
The verticals lines indicate the dates where breaks have been detected. 



Lemma 7.2 Under assumptions of Theorem \3.1\ 

= op(l) as n — > oo. 



Proof. Let k > n and T C {1, • • • , fc}. By applying the Taylor expansion to the coordinates of dL(T, -)/89, and 
using the fact that 8L(T, 6(T))/d6 = we have 

for some 0~(T) between 0(T) and 0*. 
Hence for any I 6 n ni /- 

F (0(T^) - O *) = J-A- Q L{T t ^Bl) + {F~ F(T t , h )) {6(T e , k ) - O *) 

2 ' 9 L(T Lk ,8*)--?-L(T e , k ,9*)). 



and 

F(?(T 1>n ) - 0*J = ^L(T 1)n ,0 o *) + (F — F(Ti in )) (0(Ti )n ) - O *) + 1 ( ^i(T ljn , O *) - ^L(T 1<n , 6* )) . 
Therefore, for any I G 

^((fc - £)F (9(T ilk ) - «(T U )) - 2(^L(T e<k , 9*) - ^ A i(Tl>n , <?*))) 

_A ' ~V-F^)(0>^)-^^ 



\f F(T 1<n ))(9(T 1<n ) 9*) - 2*zi-L(Ai( TliW> eS) - ^(T^, 0*)). (16) 



For k > n and with some 4£ n ni fc, we have 

1 b-t„„ ~,_ ~,_ . - 1 



F - F(T,, fc )|| \\9{T t , k ) - 0*|| < —--^-41^ - F(T ik , k )\\ \\0(T ih>k ) - 0*|| 



ien n . k b((k-£)/n) v fc 11 v ' " v u " ~ Inf6(s 



s>0 



According to 0] and [5], ||F - F(T ih , k )\\ = o P (l) and ||(9(T^, fc ) - 0*|| = CMl/x/T - ^) as fc - 4 -> oo. Hence 

sup , m n ax fcTTT ^ ^H F - ^Oll life*) - Q *|| = o P (l) as n -> oo. (17) 

fc> „ «en„, fc 6((fc - £)/n) fe 

Similar arguments imply that 

sup , m rr ax iTTi: \w ^ ^l|F-F(T 1 , n )||||0(T 1 , n )-0*||= O p(l) as ?W oo. (18) 
k>n <"en„. fc fe((fc - £)/n) k 

For k > n and for some 4 € n„ t. , we have 



115 Q 
- Inffr(s) ^k-£jde tiTtk ' k ' d * o) ~ dl^^ 1 

s>0 



1 9 - 9 
According to g], ||— L(Tt kjk , •) - ^L(T^ k , -)|j e = o P (l) as fc - 4 -> oo. Hence 

V "! — 4 Of UV 



Similar arguments show that 

RO^W^^ 11 !^"'^ " M £ < ri -^« = ° p{1) as ™ (20) 

Thus, Lemma O follows from (pj) . (fT7 |) . (p ]l . (fT9 ]l and (|20]l , ■ 



Lemma 7.3 Under assumptions of Theorem \3.1\ 

sup max — — — jrT^yJn—;— \\F ■ (9{T tik ) -6(T 1<n ))\\ — > sup sup -—— 

k>n ^en„, fc b{{k-£)/n) k „^oo t>i o<s<t t b(s) 

where Wq is a d- dimensional Gaussian centered process with covariance matrix E (Wg(s)Wq(t)') — min(s, t)G. 

Proof. We are going to apply Lemma \7. 2 1 for specifying the asymptotic behaviour of 6(T(^) — 9(T\,n)- 
For k > n and I £ we have 

v i=*+l z=l 

Now we are going to proceed in two steps. 
Step 1. Let T > 1. We have 

^ 2^,, 3 k-id „ 

max max — — tt-tt - r~ h^M^./o#o) f ) 

n<KnT ten„ |fc b{{k - t) / n) k 11 86 n 86 11 

1 " a gi (0*) 

= max max — — — > — > — „" 

n<k<nT ten n , k b((k-£)/n) k 11 ^ 86 n ^ 86 11 

1 « || l , S 9©(0g) M-H^>%(^)mi 

= max max — — — = F — 1W - — T — =( > — > — III. 

te{i,i+±,. .. ,t} se{i-^-,2-^, t— ^} - [ns])/n) [nij 11 \/n _r~f ^ n ^ 86 711 

Define the set 5 := {(t, s) € [1,T] x [1,T]/ s < t}. According to [4 , ( — 10 ) t£Z is a stationary ergodic martingale 
difference sequence with covariance matrix G. By Cramer- Wold device (see [9] p. 206), it holds that 

1 g ^ 
Jn ^ 86 n->oc 

v i=[ns] + l 

with — > means the weak convergence on the Skorohod space T>(S). Hence 

n— >oo 

i g a^)_ M -H^fl^) ) ^ WG(f _ s) _ (t _ s) ^ G(1) . 

, /rj v ^- — ^ n ^ — ' /^fV 7 n.— voo 



Therefore 



i=[ns] + l i=l 



max max -- — 1 -_^-- || j-L(T £ fc , gg) - — - j-Lffl .„, 0*)|| 
n <t<nT«en„, t b((k-£)/n) k 11 (90 v ■ o; n 90 V ' 

v \\W G (t - s) - {t - s)W G (l)\\ 
— > SU P SU P TTu n 

n^oo 1<«T Ks<l I 0(1 — SJ 



c ||W G (s)-aW G (l)|| 

— ► sup sup — . (21) 

n->oo 1<«T Ks<( J O^SJ 



Step 2. We will show that the limit distribution (as n,T — > oo) of 



exists and is equal to the limit distribution (as T —> oo) of 

\\W G (s) - sW G (l)\\ 
sup sup —— . 

t>T Ks<t t b(s) 

Let k > nT. We have 

VV /7 ' s>0 V ' i=4+l 

It comes from the Hajek-Renyi-Chow inequality (see [TT]) that, for any e > 

i im IimP ( sup ^|| y ^M|| >e )^ . 

Hence 

sup max 1 2 ^ ||^£(T^ fc ,gg)|| =o P (l) as T,n->oo. (22) 

fc> „ T «en„, fc b((k-£)/n) k "80 

Moreover, since the function &(■) is non-increasing, for any n,T > 1, we have: 

1 2^/E„k-£ d rfrr ..... „ 1 y^ agj(g5) ,| i fc-i 

sup max -77- „. , - — - — t^tM-m n, #n) = ^^^^ / — 77. — x sup max-—-- ; N — - — 

k>nT ^n n , h b((k-£)/n) k " n 88 y ' o; " V" ^ 961 fc>«T ^n„, fc 6((fc - £)/n) fc 



: — ^ — I' x , su p 



n ^i 90 k>nT H( k - v n) / n) k 



J-l-i-f ■ 



Inf&(s)"V™^ 96* 

s >o w v i=l 

Wg(1)II. (23) 



p 1 



n-s-oo Inf b(s 

s>0 



using again the Cramer- Wold device. It comes from (|22l) and (l23l) that 

sup , m n ax i77i \v ^( r i,n. g 5)ll ^ tttttII^WII- ( 24 ) 

t>»T <en »,' b({k — l)/n) k 80 n 88 T,n-+oo Inf o(s) 

Furthermore, since the coordinates of Wg are Brownian motions, by the law of the iterated logarithm there exists 
to > exp(l) such as 

s > to =>■ || Wq(s) II < \/slog(s) almost surely. 
Thus, for any t > to, we obtain almost surely 

sup HWoOOII < sup \\W G (s)\\+Vtlog(t). 

Ks<t Ks<t 

Therefore, for T large enough, we have 

sup sup 1M < (I sup \\W G ( S )\\ + sup^) ±* 0. (25) 

Finally, since b(-) is non-increasing, for any T > 1, we have 

sup sup i^ilUi = ||W G (1)|| sup! sup -i. = ||W G (1)|| sup -1- = (26) 

t>T Ks<t tb(s) t >T* KKt 0(f) t>T 0(t) Inf t)(s) 

It comes from (|2"S"]) and ([2"B1 that the limit of (|2ip satisfies when T — » oo, 



I|W,,M - oW^flMI -r, 1 



From Step 1 and Step 2 (the relations ([21]). and (|2"7[>). it comes that 

sup max — — — — - — L^fc,^) ^-^(^l.n^o) — > SU P SU P 7T^ 

fc>nT «en„, t b{{k-l)/n) k 60 n dO "-s-oo t>T 1<s<t t b(s) 

Hence, Lemma 17731 follows from Lemma 17.21 

Proof of Theorem I3TT1 

We know that 

P{r(n) < oo} = Pi sup max — ' > 1 \ 

I k>n i€U n , k b((k~ £)/n) J 

= P{ sup max 1 ^^||g( T )-i/2^ (T ) . (0 (T ) _ fl (T )) || > A 

I fe> „ £en„, fc 6((fc - l)/n) k J 



Since G{Ti, n ) ^ G and F(Ti,„) ^4 F, it comes from Lemma 17.11 and 17.31 that 

-k-£, 



sup max 



k>n eeu n , k b((k-£)/n) k 



Hi— i||3(T 1 , B )- 1 /»F(T 1 , w ) • (0(2i, fc ) - 0(T!, 



u ||G- 1/2 (Wg(*) - «W G (1))|| 
— ► sup sup — — 

n->oo t>l l<s<t t 0{S) 



Since the covariance matrix of {Wg(s) ; s > 0}, is min(s, r)G, the covariance matrix of {G 1 ^ 2 Wg{s) ; s > 0} is 
min(s,r)Jd (where I d is the d-dimensional identity matrix). Hence Theorem 13.11 follows . M 

Proof of Corollary 13.11 

Since b = c a positive constant, it follows immediately from Theorem 13. II that 



lim P{r(n) < oo} = pjsup sup -\\W d (s) - sW d (l))\\ > c). 



■V>\ Ks<t 
1 v 

Now, it suffices to show that sup sup ~||Wd(s) — S H^(1))|| = U d . 

t>i i<i<t t 

For any t > 1, we have 

sup \\\W d (s)-sW d {\))\\ = sup J \\W d (—)\\= sup 1 ||W d (u)||. 

1<K( * KKt 1 s 0<u<l-l/t H 1 — M J 

Thus 

sup sup i ||W d (s) - sW d (l))|| = sup sup — — — -||W d (u)|| = sup sup \ — - ||W d (u)||. 

t>l Ks<t t (>l o<u<l-l/t H 1 — U J 0<v<l 0<u<v i-—U 

But, ||W d (u)|| = w 1 / 2 Therefore with u = u'v, 

1 - v (1 - wlu 1 / 2 
sup sup ||W d (u)|| = sup sup — ||Wd(tt)||. 

0<u<l 0<u<v i — U Q<v<l 0<u'<l i ~ U V 

(l-v)v 1 / 2 _ 

It remains to compute sup . Classical computations show that this supremum is obtained by v = 

o<v<i I -u'v 

2 (3 - u' + y/(9-u')(l - u'))^ 1 and therefore 

sup sup -\\W d {s) - sW d {\))\\ = sup f(u')\\W d (u')\\ 

t>l Ks<t t 0<«'<1 

.. \/9 -u' + \/T _ 17 / 2 \V2 . . 



Hence, 

sup sup \\\W d {s)- sW d (l))\\=U d 

t>l Ks<t t 



Proof of Theorem | 

Denote k n = k* + n s for 5 G (1/2, 1). For n large enough, we have v n < n s and thus k n — v n = fc* + n 5 — u„ > fe*. 
Moreover, since k* > n then fc* G n„ fe for n large enough. 

In addition, since k* — k*(n) > n and limsup n _ voo k*(n)jn < oo, there exists Co > 1 such that k* < co?t. for n large 
enough. Hence, according to assumption B, there exists a constant c > such that 

( ' ' 1 ^^r^lIGm,,,)- 1 / 2 ]?^,,,) • {e kn (T i<kn ) - 0(T llB )) 



t>en„, fen b((k n - t)/n) ieu„ ikn b((k„ - t)/n) k n 

> — l —^,/^^-\\G{T hn )- 1 l*F{T hn ) ■ (e kn {T k *, kn ) - 0{Ti,n)) 



b((k n -k*)/n) k n 
^ c ^ I^rx^l|G(Ti, n )- 1 / 2 F(Ti,„)(^ n (T fc ,, fe J -e(T 1>n ))\ 



k* 

1/2+8 



> c -^\\G(T hn r^ 2 F(T hn )(e kn (T k ,. k J - 9(T hn ))\\ 

^ C f ,^J lg( T l,n)~ 1/2 -F( T l,n)(gfcn(^,fcJ-^l,n))l[. (29) 
(Co + 1)" 



71— >-00 



According to @] and [IB], G(T 1: „) ^4 G, F(T 1)tl ) ^> F, 9(T 1<n ) ^ 0* o and kn (T k , M ) ^ 6\. 

n— >oo n—¥oo n— ¥00 

Since G is symmetric positive definite, F is invertible, 0$ ^ 9\ and 5 > 1/2 , then (|2T))) implies that 

a .s. 



een ntkn b((k n -l)Jn) 



oo. 
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